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1  Introduction 

Both  linear  and  nonlinear  time  series  can  have  directional  features,  features  which 
indicate  that  the  series  do  not  maintain  identical  statistical  properties  when  the 
direction  on  the  time  scale  is  reversed.  The  main  purpose  of  the  present  paper  is 
to  develop  the  analysis  of  these  features  and  to  indicate  and  illustrate  how  they 
can  be  used  for  the  investigation  and  modelling  of  linear  or  nonlinear  autoregressive 
statistical  models.  In  particular,  the  primary  aim  of  the  paper  is  to  introduce  the 
idea  of  reversed  residuals  (mentioned  in  discussion  to  Green  (1984)  and  Lawrance 
and  Lewis  (1985)),  and  to  develop  some  of  their  properties.  Reversed  residuals  in 
general  are  residuals  which  would  have  been  obtained  if  time  ran  in  the  opposite 
direction  and  arise  naturally  when  considering  partial  autocorrelations  for  time  se¬ 
ries;  cross  correlations  of  residuals  and  squared-reversed  residuals  allow  extensions 
of  model  identification  ideas  given  in  Lawrance  and  Lewis  (1986).  Particular  pairs 
of  reversed  and  ordinary  residuals  are  shown  to  produce  partial  autocorrelation  co¬ 
efficients:  quadratic  types  of  partial  autocorrelation  coefficients  are  introduced  to 
assess  dependence  associated  with  nonlinear  models  which  nevertheless  have  linear 
autoregressive  (Yule- Walker)  correlation  structures. 

A  parallel  theoretical  study  in  this  paper  concerns  the  use  of  reversed  residuals 
in  the  investigation  of  random  coefficient  autoregressive  models  (Andel,  1976,  1983; 
Vervaat,  1979;  Nicholls  and  Quinn,  1982);  the  class  includes  the  NEAR(l)  models 
of  Lawrance  and  Lewis  (1981)  with  exponential  marginals,  the  BGAR(l)  models 
of  Lewis  et  al  (1989)  with  tan.  ia  marginals  and  the  PBAR  models  of  McKenzie 
(1985)  with  beta  marginals.  .  *  .,ult  for  all  such  models  is  given  concerning  a  cut¬ 
off  property  of  quadratic  cross- correlations  of  the  ordinary  and  reversed  residuals: 
a  partial  reversibility  condition  in  terms  of  moments  for  these  models  is  also  stated. 

The  relevance  of  our  concerns  here  with  directionality  is  due  to  the  fact  that  most 
nonlinear  processes  are  directional,  and  amongst  linear  autoregressive  processes,  the 
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Deseasonaiized  Data 
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Figure  1:  Autocorrelation  functions  of  deseasonaiized  Stour  river  data  and  the  residuals 
from  a  first  order  autoregressive  fit  to  that  data.  The  bands  define  approximate  confidence 
intervals  on  the  autocorrelations  for  lag  greater  than  zero  on  the  assumption  that  the  true 
autcorrelation  function  is  zero  for  lags  greater  than  zero. 


only  non-directional  or  reversible  ones  are  Gaussian.  This  latter  fact  forms  part  of 
a  central  result  due  to  Weiss  (1975)  and  indicates  that  use  of  reversed  residuals  is 
also  of  relevance  to  assessing  the  linearity  of  non  Gaussian  autoregressive  processes. 

The  use  of  reversed  residuals  is  illustrated  on  a  series  of  deseasonaiized  monthly 
British  riverflow  data  in  which  it  is  shown  that  there  is  some  nonlinear  first  or¬ 
der  autoregressive  dependency.  The  data  is  monthly  flow  data  of  the  River  Stour, 
Stourport,  Gloucestershire,  England,  from  1918  to  1945;  there  are  444  data  values 
in  all.  Following  common  hydrological  practice,  it  has  been  deseasonaiized  by  stan¬ 
dardizing  each  value  by  subtracting  its  own  monthly  mean  and  dividing  by  its  own 
monthly  standard  deviation.  This  is  effective  in  reducing  the  flows  to  a  stationary 
series;  the  marginal  distribution  of  the  deseasonaiized  data  is  non  Gaussian  and 
very  positively  skewed.  The  autocorrelation  is  reasonably  geometric  as  can  be  seen 
from  the  left  hand  panel  in  Figure  1,  and  the  partial  autocorrelation  function  (not 
shown)  cuts-off  at  lag  2  as  expected.  Furthermore,  the  fit  of  a  first  order  linear 
autoregressive  model  is  satisfactory  as  judged  by  the  autocorrelation  function  of  its 
residuals,  shown  in  the  right  hand  panel  of  Figure  1.  More  formally,  testing  shows 
that  the  cumulated  periodogram  of  the  residuals  is  consistent  with  an  hypothesis  of 
uncorrelated  residuals.  This  result  is  confirmed  by  modified  Box-Pierce  chi-square 
statistics  at  12,  24,  36  and  48  lags. 

Reversed  autoregressive  residuals  are  introduced  in  the  next  section.  The  pur¬ 
pose  of  this  paper  is  to  see  what  further  can  be  said  about  autoregressive  fits,  and 
in  particular  about  the  first  order  fit  to  the  Stour  river  data,  by  using  third  and 
fourth  joint  properties  of  both  the  residuals  and  reversed  residuals.  For  this  pur¬ 
pose  cross  correlations  of  residuals  and  squared  reversed  residuals,  as  well  as  other 
combinations  of  the  residuals,  are  examined.  In  addition,  quadratic  types  of  partial 
correlation  coefficients  are  introduced. 
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2  REVERSED  RESIDUALS 


Consider  the  time  series  {AT*}  which  is  stationary  with  mean  zero;  the  pth  order 
autoregressive  residual  sequence  for  this  series  is  defined  as 

R(tp)  =  Xt-axXt.x-...-apXt.p,  t  =  0,±1,±2,..;  (1) 

where  c*i,  a2, . . .  ,pp  are  chosen  to  minimize 

E{Xt  -  axXt.x  -  <x2Xt.2  -  ...  -  apXt.p)2.  (2) 

If  the  true  model  for  {X*}  is  autoregressive  of  order  p,  then  ax,a2,.  ,ap  are  its 
coefficients  and  R$  is  its  innovation  term;  in  general  01,02, ...  ,ap  are  given  by  p 
linear  equations  of  the  Yule- Walker  type  involving  the  autocorrelations  of  {Aft}. 
The  reversed  pth  order  autoregressive  residuals  of  {Xf}  are  correspondingly  defined, 
with  the  index  t  increasing,  as 

=  Xt-  0xXt+x  -  (32Xt+2  -  ...  -  0pXt+p  t  =  0,±1,±2,...  (3) 

and  0x,02,...,0p  minimizing 

E(Xt  -  (3xXt+x  -  02Xt+2  -  ...  -  0pXt+p)2.  (4) 

The  0's  thus  satisfy  an  identical  set  of  linear  equations  to  those  of  ai,a2, . . . ,  op. 
Calculation  of  the  residuals  and  reversed  residuals  will  be  based  on  ordinary  least 
squares  regression  rather  than  the  nearly  equivalent,  Gauscian  theory,  first  order 
autoregressive  likelihood. 

Suppose  the  available  data  series,  after  correction  for  its  mean  x  is  given  by 
(xx,x2, . . .  ,xn).  It  is  convenient  when  dealing  with  pth  order  residuals  to  form  the 
display 


xx 

X2 

x3 

...  xp 

Xp+l 

X2 

X3 

X4 

■  ■  ■  Xp+X 

Xp+2 

xn—p—l 

xn—p 

Xn—p+1 

•  •  •  2 

Xn-l 

Xn-p 

Xn-p+1 

xn-p+2 

•  •  •  ^n— 1 

xn 

The  pth  order  reversed  residuals  are  then  formed  as  the  residuals  from  regressing 
the  first  column  on  the  p  subsequent  columns;  similarly,  pth  order  ordinary  residuals 
come  from  regressing  the  (p  +  1)<A  column  on  the  p  previous  columns.  In  this  way, 
the  coefficients  oi,a2, . . .  ,op  in  (1)  and  0X,02, . . .  ,0P  in  (3)  are  implicitly  estimated, 
but  never  needed  explicitly:  they  will  not  be  estimated  as  equal,  which  theoretically  Jn  For 
they  are,  in  order  to  make  most  use  of  the  available  data.  An  alternative  procedure 
would  be  to  use  one  or  a  combination  of  the  two  estimated  sets  for  both  residuals  3 
and  reversed  residuals  ;  there  are  implications  of  these  comments  to  the  calculation  .need 
of  partial  correlation  coefficients,  to  be  given  in  Section  5.  cation. 

An  alternative  procedure,  mentioned  initially  could  be  to  assume  a  standard  pth - 

order  linear  Gaussian  autoregressive  model  for  the  {X(};  however,  there  is  no  real _ 
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Figure  2:  Histogram  for  the  ordinary  residuals,  and  empirical  quantile-quantile  plot  for 
the  ordinary  and  reversed  residuals  for  the  Stour  data. 

justification  for  this,  except  that  the  maximum  likelihood  estimates  of  the  coefficients 
would  correspond  very  closely  to  the  regression  estimates  of  ai,a2,. . .  ,ap.  Fitting 
to  the  reversed  series  would  similarly  give  estimates  of  the  parameters  /31 ,  /32,  •  •  •  ,  Pp- 

The  structure  of  reversed  residuals  is  rather  complicated  even  in  the  situation 
when  the  order  considered  is  that  of  the  true  linear  autoregressive  model;  they  do 
not  have  the  same  distribution  as  that  of  the  ordinary  residuals  and  they  are  not 
serially  independent.  It  is  straightforward  to  see,  however,  as  in  Lawrance  and  Lewis 
(1986)  for  the  ordinary  residuals,  that  the  reversed  residuals  are  uncorrelated  un¬ 
der  the  linearly  correct  order  of  autoregression,  that  is  Yule- Walker  autoregression; 
moreover,  they  have  the  usual  cut  off  property  at  the  correct  order  of  autoregressions 
as  associated  with  the  ordinary  residuals  of  autoregressive  models.  The  cross  cor¬ 
relation  function  of  the  ordinary  and  reversed  residuals  is  also  zero  at  negative  lags 
less  than  the  degree  of  Yule-Walker  autoregression.  These  features  are  all  evident 
in  the  corresponding  plots  of  the  Stour  data;  a  histogram  of  the  ordinary  residuals 
is  given  in  the  right  hand  panel  in  Fig  2.  The  distributions  of  both  the  ordinary  and 
reversed  residuals  for  these  data  are  compared  in  the  empirical  quantile-quantile 
plot  shown  in  the  left  hand  panel  in  Figure  2.  The  distributions  differ  significantly 
in  the  tails.  Moreover,  since  the  average  of  each  data  set  is  approximately  zero,  it 
is  seen  that  both  data  sets  are  positively  skewed  and  thus  non-normal. 

To  illustrate  the  structure  of  reversed  residuals  consider  the  linear  AR(1)  model 
given  by 


Xt  =  pXt- 1  +  €f 

(5) 

Then 

RRl"  =  Xt  -  pXt+i  =  (1  -  p2)Xt  -  pet+i 

- 

=  -p€,+,  +  ( 1  -  p2)  jet  +  • 

(6) 

It  is  seen  that  for  this  linear  AR(1)  model  is  dependent  on  et+j,et,ct_i, . . . 

but  that  it  will  be  independent  of  €(+2,  f<+3,  •  •  • ,  that  is,  independent  of  the  ordinary 
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residuals  ^l+3>  •  •  ••  However,  the  {•ft.ftj1*}  sequence  itself  is  dependent  at  all 
lags,  unless  the  {t(}  are  Gaussian. 

The  main  motivation  for  reversed  residuals  in  general  is  that  they  capture  di¬ 
rectionality  in  a  meaningful  manner  and  allow  model  validation  or  criticism  to  be 
extended  both  beyond  standard  linear  methods  and  differently  from  higher  order 
methods  involving  ordinary  residuals.  The  relevant  class  of  models  will  naturally 
include  a  Yule- Walker  autoregressive  aspect,  but  will  in  general  be  nonlinear.  The 
correct  order  of  this  linear  autoregression  is  assumed,  as  determined  by  conven¬ 
tional  means.  The  autoregressive  aspect  then  leads  to  uncorrelated  reversed  resid¬ 
uals  and  the  suggestion  is  to  obtain  measures  of  their  higher  order  dependency 
which  can  be  compared  with  corresponding  estimated  quantities.  We  will  suggest 
some  “quadratic”  correlations  involving  the  squaring  of  residuals  and  reversed  resid¬ 
uals.  An  assessment  of  reversibility  can  also  be  based  on  the  quadratic  correlation 
function. 

3  USEFUL  QUANTITIES  IN  TERMS  OF  RESIDU¬ 
ALS  AND  REVERSED  RESIDUALS 

In  a  previous  paper  (Lawrance  and  Lewis,  1986),  use  was  made  of  higher  order 
correlations  of  the  ordinary  residuals  as  a  means  to  help  identify  nonlinear  autore¬ 
gressive  processes  which,  nevertheless,  had  Yule-Walker  linear  autoregressionss.  In 

particular  attention  was  directed  at  Corr  for  a  pth  order  standard 

linear  autoregressive  process  these  correlations  are  zero,  and  for  a  nonlinear  process 
with  pth  order  Yule- Walker  autoregressions  the  residuals  are  uncorrelated 

but  dependent.  Thus  the  higher  order  correlations,  which  will  be  called  quadratic 
correlations  when  they  involve  squaring,  — such  as  that  just  cited — give  an  assess¬ 
ment  of  the  uncorrelated  dependence;  Granger  and  Anderson  (1978)  first  considered 
the  autocorrelations  of  squared  residuals.  As  a  data  analysis  tool,  these  correlations 
would  be  estimated  for  a  range  of  lags  for  given  p,  the  value  of  p  having  already 
been  determined  by  a  Yule-Walker  linear  analysis.  The  further  analysis  is  then 
concerned  with  diagnosing  nonlinear  features  in  the  autoregressions.  Model  based 
calculations  of  these  quadratic  correlations  allow  an  assessment  of  whether  the  data 
is  in  reasonable  agreement  with  the  (non-linear)  autoregressive  model. 

With  the  introduction  of  reversed  residuals  there  are  three  further  possible  pairs 
of  quadratic  correlations  which  could  be  examined,  that  is  correlations  of 

(Mp\  RR[fr )  ,  (r!p)\  RR<p)r)  ,  (rr\p\  RR{tfr)  ,  r  =  ±1,  ±2, . . .  (7) 

It  still  seems  to  be  a  matter  of  experience  which  of  these  is  most  useful  in  model 
validation;  when  considering  them  for  a  range  of  positive  and  negative  values  of  r, 
they  are  all  basically  functions  of  third  moments  of  the  form  E  ( X t3) ,  E  (X?Xt+r) 
and  E  (XtXt+rXt+s) .  One  possible  guide  to  their  use  couid  be  any  special  properties 
which  might  be  exploited  in  relation  to  the  type  of  model  of  interest;  properties  of 
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Figure  3:  Autocorrelation  function  of  squared  ordinary  and  reversed  residuals  for  the 
Stour  data.  The  bands  define  approximate  confidence  intervals  on  the  autocorrelations  for 
lag  greater  than  zero  on  the  assumption  that  the  true  autcorrelation  function  is  zero  for  lags 
greater  than  zero. 


these  correlations  for  linear  and  random  coefficient  first  order  autoregressive  models 
will  be  considered  in  Section  5. 

For  the  Stour  data,  the  autocorrelation  function  of  the  squared  ordinary  and 
reversed  residuals  are  given  in  Figure  3.  The  autocorrelation  at  lag  1  of  the  ordinary 
squared  residuals  is  evidence  here  of  the  non-linearity  in  the  series.  The  nonlinearity 
is  also  picked  up  in  the  autocorrelation  function  of  the  squared  reversed  residuals.  A 
matrix  of  the  third  order  cross- correlation  functions,  three  of  which  are  given  in  (7) 
is  given  in  Figure  4  and  will  be  interpreted  against  the  theoretical  results  for  linear 
and  random  coefficient  models  in  Section  6. 

Another  use  of  these  quantities  will  be  in  connection  with  detecting  directionality. 
For  instance  the  marginal  distributions  of  R\p^  and  RR\P^  will  be  equal  for  reversible 
processes  and  the  scatters  of  R ^  and  RI^P^  should  be  symmetric  about  the  45° 
line.  If  reversibility  is  restricted  to  relevant  moment  conditions  then  the  correlation 
function  of  the  first  two  pairs  in  (7)  should  be  mirror  images  of  each  other;  similarly, 
the  last  pair  of  (7)  should  equal  the  corresponding  quantity  in  terms  of  ordinary 
residuals. 

It  is  seen  from  Figure  4  that  for  the  Stour  data  there  is  no  evidence  for  reversibil¬ 
ity.  In  particular,  the  plot  in  the  upper  right  quadrant,  even  allowing  for  sampling 
variability,  is  different  from  that  in  the  lower  left  quadrant.  So  are  the  plot  in  the 
upper  left  quadrant  and  the  plot  in  the  lower  right  quadrant,  as  predicted  if  there 
is  non-linearity  in  the  data. 


6 


Figure  4:  Crosscorrelation  functions  for  the  third  order  dependency  of  ordinary  and 
reversed  residuals  for  the  Stour  data.  Bands  are  individual  95%  confidence  intervals  for  the 
crosscorrelation  estimates  under  the  hypothesis  of  independence  between  the  two  series. 

4  QUADRATIC  TYPES  OF  PARTIAL  CORRELA¬ 
TION  COEFFICIENTS 

The  introduction  of  reversed  residuals  allows  the  familiar  partial  autoregression 
function  of  time  series  analysis  to  be  seen  to  some  advantage.  A  discussion  of  the 
usual  indirect  definition  of  partial  autocorrelations  involving  autoregressive  models, 
and  advocacy  of  the  direct  definition,  is  given  in  Lawrance  (1979);  it  is  pointed  out 
there  that  a  partial  autocorrelation  is  the  ordinary  correlation  between  two  random 
varaiables  after  their  linear  dependence  on  the  partialed  out  random  variables  has 
been  subtracted  out.  Thus  taking  the  direct  approach  here,  consider  Xt  and  Xt+p', 
the  pth  partial  autoregressions  can  be  defined  as  the  correlation  between  Xt  and  Xt+P 
-  after  each  has  been  adjusted,  in  the  least  squares  sense,  for  its  linear  dependence 
on  the  intervening  At+i,  At+2,  •  •  • ,  Af+p.]  .  The  adjusted  Xt  and  Xt+P  are  then 
simply  seen  to  be  the  reversed  residual  RR[P~^  and  the  ordinary  residuals  R^p\ 
respectively.  In  the  nartial  correlation  of  Xt  and  Xt+P  notice  that  p(p  >  2)  is  the 
lag  and  p  -  1  is  the  order  of  the  residuals  used;  the  lag  1  partial  autoregressions  is, 
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by  convention,  the  ordinary  lag  1  autoregressions.  Partial  autoregressions  will  often 
be  calculated  or  estimated  for  p  =  2,3,...  and  used  in  determination  of  p,  rather 
than  with  p  held  constant  as  we  have  previously  suggested  in  higher  order  model 
validation. 

The  earlier  introduction  of  quadratic  cross  correlations  suggest  the  use  of  two 
quadratic  partial  autoregressions  of  the  form 

Cott  | RR(rl),  ( *fc,)) 2 }  ,  Corr  {  2 , R^l) }  ,  p  =  2, 3, . . . .  (8) 

As  with  partial  autoregressions  for  standard  linear  autoregressive  models,  both  these 
quadratic  partial  autoregressions  will  have  cut-offs  at  the  true  autoregressive  order; 
they  will  thus  assess  the  linearity  of  the  autoregressive  structure,  maybe  indicating 
that  a  non-linear  autoregressive  model  is  required.  For  the  Stour  data,  calculation 
of  the  quadratic  partial  correlations  indicate  no  autoregressive  dependency  beyond 
lag  one.  At  lag  one  (  p  =  2  in  (8)  ),  the  first  cross  correlation  has  a  value  of  -0.121. 
For  p  =  2,  the  cross  correlations  of  (8)  are  effectively  zero.  The  cut-off  property 
does  not  depend  on  the  direction  of  autoregression. 

The  computation  of  all  the  partial  autocorrelation  functions  follows  directly  from 
the  least  squares  calculations  described  in  Section  3  to  obtain  the  ordinary  and  re¬ 
versed  residuals.  This  method  of  calculating  the  standard  partial  autoregressions 
will  usually  produce  slightly  different  results  from  the  traditional  method  of  taking 
the  last  estimated  coefficients  in  a  linear  Gaussian  autoregressive  model.  It  is  equiv¬ 
alent  to  estimating  only  the  a-set  of  coefficients  of  the  ordinary  residuals  and  using 
these  also  to  construct  the  reversed  residuals. 

5  REVERSED  RESIDUALS  FOR  RANDOM  COEF¬ 
FICIENT  AUTOREGRESSIVE  MODELS 

A  simple  nonlinear  generalization  of  standard  linear  autoregressive  models  is  to  allow 
the  coefficients  to  be  random  variables;  the  general  first  order  form  of  these  models 
is  then 

Xt  =  AtXt.1+Bu  t  =  0,±1,±2,...  (9) 

where  {X|}  has  mean  /i  and  are  independent  pairs  of  possibly  dependent 

random  variables.  A  number  of  particular  models  fit  into  this  class,  for  instance, 
the  exponential  models  of  Lawrance  and  Lewis  (1981),  the  gamma  models  of  Lewis 
et  al  (1989)  and  the  beta  models  of  McKenzie  (1985).  Currently  these  models  are 
well  developed  for  simulation  use  but  are  less  developed  in  their  statistical  aspects. 
Lawrance  and  Lewis  (1985,  1986)  considered  residuals  analysis  based  on  ordinary 
residuals  for  this  type  of  model,  and  here  attention  is  directed  at  reversed  residuals 
aspects. 

Denoting  the  first  two  moments  of  {At}  by  a  and  <12,  the  first  order  (p  =  1) 
residuals  are  given  by 


Rt  =  (X(-p)-a(X(_,-p),  RRt  =  (Xt-n)-a(Xt+i-ii).  (10) 
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Some  simple  calculations  show  that  the  cross  correlations  function  of  these  residuals 
is  given  for  the  first-order  autoregressive  random  coefficient  model  by 


Corr  {Ru  RRt-r)  =  < 


(1  —  a,2)a)r\  r  <  0 
-a  r  =  1 

0  r  >  2 


(11) 


The  form  of  this  result  has  been  anticipated  in  Section  3,  but  of  more  interest  are  the 
quadratic  cross  correlation  functions  (7).  For  (R2,RRt_ jt),  the  following  results  can 
be  obtained;  the  computations  are  straightforward  but  very  complex  and  tedious: 


Cov  (^R\,RRt-^j 


=  (a?  -  a2)(a 2  - 

a){p 3  +  k/(a2  -  a)}  a2~2. 

r  >  2 

(12) 

=  j^l  —  a  +  a3  - 

a5)  p3  ~2a(l-  a2)  (a2p3  +  *)]  a|r|, 

r  <  -1 

(13) 

=  (l  +  a2-a3- 

a5]  P3  -  2a  (l  -  a2)  (a2p3  +  k) , 

r  =  0 

(14) 

=  (—a  -  a2  -  a4 

)  P3  +  (l  +  2a2)  (a2p 3  +  k) , 

r  =  1 

(15) 

The  further  notation  here  is  that  p3  =  E(Xt—fi)3,  k  =  2a2{fiXvar(At)+Cov(At,Bt)} 
and  o2  =  uar(Xt).  This  result  is  of  interest  because  its  geometric  parameter  for  r  >  2 
is  a2  and  so  the  corresponding  estimated  correlation  function  would  give  a  possible 
way  to  estimate  the  variance  of  the  random  coefficients  At\  further,  as  will  be  seen 
in  Section  6,  p3  +  k/(a2  -  a)  is  a  measure  of  the  directionality  of  the  model.  An¬ 
other  implication  of  (12)  is  that  the  cross  correlations,  for  r  >  2,  are  zero  for  linear 
processes.  This  is  because  var(At)  =  a2  -  o2  =  0  and  therefor  a2  =  a2;  this  is  not 
so  for  r  <  2,  as  shown  by  by  (13)-  (15).  For  the  Stour  data,  Figure  4  (  lower  left 
quadrant)  shows  that  the  cross  correlations  corresponding  to  (12)  are  all  positive, 
and  although  small,  provide  further  evidence  against  linearity  of  this  data. 

For  the  pth  order  random  coefficient  autoregressive  model, 

Xt  —  a[  +  a[  ^ X(—2  +  . . .  +  A(p)Xt.p  +  Bt,  (16) 

generalizing  (9),  there  is  a  parallel  to  the  residuals  theorem  in  Lawrance  and  Lewis 

(1986).  There  is  the  following 

Theorem:  With  the  random  coefficient  model  (16) 

Corr  j  =0  for  r>p+l.  (17) 

Proof:  This  depends  on  the  independence  of  the  vector  of  coefficients 
a[2\  . . . ,  A\p\  on  previous  A{’s.  We  have 

Rt  =  Xt  -p  -  ax{Xt  -  p)  -  ...  -  ap(Xt.p  -  p)  (18) 

=  (Aj1*  -  OiJAi-!  +  ( a\ 2*  -  a2)  Xt-2  +  . .  •  +  (a[p*  -  ap)  Xt-P 

+Bt  -  (1  -  Qi  -  a2 . . .  -  ap)p  (19) 
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where  E  =  a,.  Multiplying  (16)  by  and  taking  expectations  gives 


ZE 

j= 1 


{ij^V}2]  +  je;  -  (i  -  {^-l}2  •  (20) 


Now  RR^}r  involves  Yt_r,Xt_r+j, . . .  ,Xt_(r_p);  when  r  >  p  +  1  this  sequence  is 

independent  of  a[*\  as  is  Xt-j.  Since  A[ ^  -  aj  has  zero  expectation,  so  does  the 
first  summation  in  (20),  and  the  second  is  also  zero  by  very  similar  arguments.  The 
random  coefficients  can  still  be  dependent  within  each  t  for  the  argument  to  remain 
valid.  The  theorem  is  proved  since  (20)  is  the  covariance  corresponding  to  (17).  □ 


6  REVERSIBILITY  FOR  FIRST  ORDER  RANDOM 
COEFFICIENT  AUTOREGRESSIVE  MODELS 

The  first  order  random  coefficient  autoregressive  model  (9)  will  be  fully  reversible 
when  the  joint  distribution  (Xt,Xt-i)  is  symmetric;  this  follows  from  results  of 
McKenzie  (1985)  for  first  order  Markov  models.  However,  although  this  joint  dis¬ 
tribution  was  obtained  explicitly  for  the  gamma  model  of  Lewis  et  al  (1989),  thus 
establishing  the  reversibility  of  this  process,  the  joint  distribution  cannot  be  obtained 
generally  in  an  explicit  enough  form  to  yield  a  tractable  condition.  We  thus  revert 
to  the  simplest  moment  form  of  partial  reversibility,  defined  by  the  requirement  that 

E  {(*,  -  y)  (Xt-r  -rf}  =  E{<Xt-  yf  (Xt-r  -/*)},  r  =  0,  ±1,  ±2, ...  (21) 

For  the  first  order  random  coefficients  model  (9)  expressions  for  these  joint  mo¬ 
ments  are  given  in  Lawrance  and  Lewis  (1986,  equations  (4.5)  for  r  >  1  and  (4.13) 
for  t  <  -1)  as  a^y 3  and  0^3  +  k(a 5  —  ar)/(a2  -  a),  respectively.  The  equality  of 
these  directional  moments,  for  all  r,  yields  the  condition 

yz  + k/(a2  -  a)  =  0.  (22) 

This  condition  simplifies  a  little  when  At  and  Bt  are  independent  and  can  then 
be  written  as 


yz  =  2yo2 var(At) / {a{  \  -  a)  -  t?ar(/4t)}.  (23) 

Note  in  particular  that  the  skewness  of  Xt  is  non-zero  unless  var(At)  =  0,  as  it  is 
in  the  case  of  the  linear  model;  the  skewness  can  otherwise  be  zero  when  At  and  Bt 
are  correlated. 

~  It  can  be  seen  from  (12)  that  Corr  (Rf,RRt-r)  for  (r  >  2)  is  zero  when  the 
process  satisfies  the  reversibility  condition  (22);  this  could  be  a  useful  result  in 
model  validation.  In  this  respect  also,  consideration  of  Corr  (R^Rt-r)  as  derived 
in  Lawrance  and  Lewis  (1986,  equation  (4.14)),  is  relevant.  This  can  be  cast  in  the 
new  form,  for  r  >  1,  of 
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Cov(Rt,Rt-T )  = 


a  2  —  a‘ 
1  -  aa.2 


^3  + 


a2 


h}<"- 


g(l  -  g)(l  -  a2) 
a.2  -  a. 


k  a 


T—  1 


(24) 


Thus,  under  the  reversibility  condition  (22),  the  first  term  is  zero  and  Corr(Rf,Rt-r) 
is  geometrically  decreasing  in  the  parameter  a.  It  is  such  special  simplifications 
which  justify  the  consideration  of  more  than  one  of  the  mathematically  equivalent 
cross  correlation  functions  described  in  Section  4. 
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